Papers with noisy datasets
The Data Frontier for Large Language Models: Selection, Synthesis, and Tools (2026.acl-tutorials)
Copied to clipboard
| Challenge: | acquiring and curating high-quality training data remains a significant bottleneck . acquiring such high-quality data is a key challenge for researchers and practitioners . |
| Approach: | This tutorial provides a comprehensive and practical guide to the state-of-the-art in data research directions for LLMs. |
| Outcome: | The tutorial covers methods for curating the most valuable information from vast, noisy datasets and the synthetic data revolution. |
A Confidence-based Acquisition Model for Self-supervised Active Learning and Label Correction (2025.tacl-1)
Copied to clipboard
Carel van Niekerk, Christian Geishauser, Michael Heck, Shutong Feng, Hsien-chin Lin, Nurul Lubis, Benjamin Ruppik, Renato Vukovic, Milica Gašić
| Challenge: | Existing approaches to training deep neural networks require large amounts of meticulously annotated data. |
| Approach: | They propose a pool-based active learning framework that requires expert annotators to label only a fraction of a sequence and facilitates self-supervision for the remainder of the sequence. |
| Outcome: | The proposed model outperforms baselines on dialogue belief tracking tasks. |
DeezyMatch: A Flexible Deep Learning Approach to Fuzzy String Matching (2020.emnlp-demos)
Copied to clipboard
| Challenge: | DeezyMatch is a free, open-source software library written in Python for fuzzy string matching and candidate ranking. |
| Approach: | They propose to use DeezyMatch to train new classifiers and fine-tune a pretrained model to generate rich vector representations from string inputs. |
| Outcome: | The proposed algorithm can be used to find the best matching candidates in large knowledge bases and query sets. |
Benchmarking Commercial Intent Detection Services with Practice-Driven Evaluations (2021.naacl-industry)
Copied to clipboard
| Challenge: | Intent detection models require large amounts of labeled data to achieve high accuracy, and in practical scenarios it is more common to find small, unbalanced, and noisy datasets. |
| Approach: | They benchmark intent detection methods on a variety of datasets and found that Watson Assistant's model outperforms other commercial solutions. |
| Outcome: | The proposed model outperforms pretrained language models on a variety of datasets while requiring only a fraction of computational resources and training data. |
SaFER: A Robust and Efficient Framework for Fine-tuning BERT-based Classifier with Noisy Labels (2023.acl-industry)
Copied to clipboard
| Challenge: | Existing noise-handling methods could not improve performance of BERT on noisy datasets . existing methods could only improve performance on noisy data, authors say . |
| Approach: | They propose a fine-tuning framework for BERT-based text classifiers that combats label noises without access to clean data for training or validation. |
| Outcome: | The proposed framework achieves superior performance on multiple text classification benchmarks. |
Noisy Self-Knowledge Distillation for Text Summarization (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to summarize text using a single reference and noisy datasets are ill-suited to summarising on single reference datasets. |
| Approach: | They propose to use self-knowledge distillation to improve text summarization by generating smoothed labels for students and teachers to reduce model uncertainty. |
| Outcome: | The proposed framework improves on pretrained and non-pretrained models on three benchmarks. |
Robustification of Multilingual Language Models to Real-world Noise in Crosslingual Zero-shot Settings with Robust Contrastive Pretraining (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing studies on robustness of pretrained multilingual models are limited to the English language. |
| Approach: | They propose to use data augmentation and contrastive loss term to boost robustness of multilingual models in cross-lingual settings. |
| Outcome: | The proposed model outperforms existing models on clean and noisy data in the cross-lingual setting. |
Evaluating Text Coherence at Sentence and Paragraph Levels (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing text ordering models have been used to test coherence in NLP for a long time. |
| Approach: | They propose to perform paragraph ordering task and sentence ordering by using four corpora from different domains. |
| Outcome: | The proposed model performs better under certain extreme conditions than the most prevalent metric used before. |
Learning Robust Latent Representations for Controllable Speech Synthesis (2021.findings-acl)
Copied to clipboard
| Challenge: | Variational Auto-Encoders (VAEs) for learning disentangled latent representations in speech fail to learn latent clusters of speaker attributes when trained on limited or noisy datasets. |
| Approach: | They propose a Variational Auto-Encoder (VAE) that minimizes mutual information between latent variables and learns controllable latent representations in speech data. |
| Outcome: | The proposed model reduces the cluster overlap of speaker attributes by 30% over LSTM-VAE. |
WeTS: A Benchmark for Translation Suggestion (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on overall performance of machine translation but ignore TS performance, authors say . if TS is applied into post-editing, it will reduce the time and cost of post-production. |
| Approach: | They propose to use a golden corpus annotated by experts to generate a translation suggestion model. |
| Outcome: | The proposed model improves on the golden corpus annotated by translators on four translation directions. |
Memorisation versus Generalisation in Pre-trained Language Models (2022.acl-long)
Copied to clipboard
| Challenge: | State-of-the-art pre-trained language models have been shown to memorise facts and perform well with limited amounts of training data. |
| Approach: | They propose to extend pre-trained language models to generalise and memorise facts in noisy and low-resource scenarios. |
| Outcome: | The proposed extension improves performance in low-resource named entity recognition tasks. |
Denoising Large-Scale Image Captioning from Alt-text Data Using Content Selection Models (2022.coling-1)
Copied to clipboard
| Challenge: | Recent approaches to training large-scale image captioning (IC) models often fall short in terms of performance in leveraging noisy datasets in favor of clean annotations. |
| Approach: | They propose a technique that breaks down the task into two smaller, more controllable tasks - skeleton prediction and skelet-based caption generation. |
| Outcome: | The proposed method can generate better and denoised captions when using noisy datasets. |
Latent Factor Models Meets Instructions: Goal-conditioned Latent Factor Discovery without Task Supervision (2025.naacl-long)
Copied to clipboard
Zhouhang Xie, Tushar Khot, Bhavana Dalvi Mishra, Harshit Surana, Julian McAuley, Peter Clark, Bodhisattwa Prasad Majumder
| Challenge: | Instruction-following LLMs have recently allowed systems to discover hidden concepts from a collection of unstructured documents based on a natural language description of the purpose of the discovery (i.e., goal). |
| Approach: | They propose a goal-oriented latent factor discovery system that integrates LLM’s instruction-following ability with statistical models to handle large, noisy datasets where LLM reasoning alone falls short. |
| Outcome: | The proposed system improves task performance by 5-52% over baselines and 1.8 times as often as the best alternative, on average, in human evaluation. |